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TITLE 

Method for processing the signals from two or more microphones in a listening device 
and listening device with plural microphones. 

5 AREA OF THE INVENTION 

The invention relates to listening devices such as hearing aids and in particular to 
listening devices having a casing and an array of microphones comprising two or more 
microphones, a signal processing device, and a receiver for delivering an output to the 
1 0 user of the listening device. Such devices encompass hearing aids and headsets and 
various other assistive listening devices. 

BACKGROUND OF THE INVENTION 

15 In listening devices of this kind it is a problem that the microphones need to be closely 
matched in order for a possible directional computational algorithms to function 
optimally. In order that the microphone stay matched over a long period, an automatic 
matching process is introduced. Here the signals from the microphones are continually 
analysed to ensmre that over time there is no big difference in the output level from the 

20 microphones. In such Ustening devices it is also a problem, that when the casing is 

accidentally touched or touched when applied to the ear, very loud sound output levels 
may be produced as the microphones are very sensitive to noise propagated through the 
material of the casing walls. 

25 If substantial differences in the input to the microphones should occur, this might comipt 
the outcome of the automatic matching process. Further it has been discovered that such 
large differences are most likely to coincide with the occurrence of large and impleasant 
noises which the user would prefer not to hear like the noise which is produced when the 
casing is touched by the user. In hearing aids a large gain or amplification of the audio 

3 O signal is introduced to compensate for the hearing loss of the user. This amplification 
amplifies all signals, wanted as well as non-wanted. The wanted signals usually 
originates some distance from the hearing aid and arrives travelling through the air. 
Noise from touching the hearing aid is very unpleasant since it results in a loud output 
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signal from the hearing aid because of the frictional resistance, the bangmg from fhe 
acceleration of fingers ect. The noise increases as the origin of the noise moves closer to 
one of the microphones in a multi-microphone hearing aid. 

5 SUMMARY OF THE INVENTION 

To overcome to above problem the inventions provides a mettiod for processing the 
signals from two or more microphones in a listening device wliereby the signals from the 
microphones are analysed in order to detect when the casing is touched, whereby 
10 changes in the signal processing are effected whenever touching of the casing is 
detected. 

According to the invention, the time dependent differences in short term energy in the 
signals from the microphones is determined. This time related change may in itself 
15 provide information as to possible touching of the hearing aid casing, and also it may be 
frirther analysed to detect the occurrence of something or somebody touching the hearing 
aid casing with a higher degree of certainty. 

Preferably the time related change in difference in the short term energy content in the 
20 microphone signals is used to determine the rate of change in difference between the 
short term energy of the microphone signals. Here touching noise will change the 
difference in measured energy between the two microphones very fast compared to other 
signals received by the microphones. Noise generated by wind will also change the input, 
but since it originates from turbxilence, the mean energy level firom the two nncrophones 
25 will not change fast because of the tmcorrelated nature of the wind noise. Other ways of 
detecting touching noise are possible, but the short term energy differences are easily 
detected and it is easy to determine a reliable threshold where the signal processing 
should react to compensate for the loud noise. The threshold my comprise both a 
threshold for the absolute value of the difference in short term energy and a threshold for 
30 the rate of change of the difference in short term energy. 

In an embodiment of the invention, the changes in the signal processing which are 
effected whenever touching of the casing is detected comprises short term muting or 
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attenuation of the output signal in order to protect the user from the annoyance of the 
loud sounds caused by the touching of the casing. 



In yet another embodiment of the invention, the changes in the signal processing which 
5 are effected whenever touching of the casing is detected comprises a time limited shut 
down of an automatic microphone matching process. In this way it is ensured, that the 
matching process is not disturbed by the large short term differences in the energy 
contents of the signal from the microphones. 



10 In a further embodiment of the invwtion, the changes in the signal processing which are 
effected whenever touching of the casing is detected comprises lasting changes in tiie 
processing of the audio signal presented to the user of the listening device. Such changes 
could be program shifts, volume op or down or permanent muting of the listening device 
according to the wishes of the user. 

15 

BRIEF DESCSEUPTION OF IHE DRAWINGS 



Fig. 1 shows the diagram of a detector to detect touch noise, 

Fig. 2 shows the time related difference in short tenn energy content in two microphone 
20 channels where the soimd level in the environment is low. 

Fig, 3 shows the time related differences in short term energy content in two microphone 
channels where the sound level in the environment is high. 

Fig. 4 shows the time related difference in short term energy content in two microphone 
channels whereby two distinct detections of touching events are made within a given 
25 time. 

DESCRIPTION OF A PREFERRED EMBODIMENT 

Figure 1 shows one way to detect touching noise. Two microphones are provided which 
30 transform acoustical signals to analog electric signals. The analog signals are 

transformed into tiie digital domain in analog to digital converters. The signals are then 
transferred to a DSP unit or similar signal processing element. In the DSP unit the digital 
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signal is treated in order to determine whether the signal from the microphones originates 
fix>m the surroundings or is caused hy something touching the shell of the hearing aid. 

Initially a mean value of the energy in each of the two channels is calculated. One way to 
5 detect whether a signal originates from a touching noise is to analyse the difference or 
ratio between the energies in the two channels. If the ratio makes a fast shift, this is an 
indication that the signal originates from touching noise. When the presence of such a 
signal is determined a value within the DSP is shifted, and other parts of the DSP unit 
may react to the shift of this value. One reaction could be to stop the automatic procediure 

10 for amplitude and/or phase matching of the two micropliones. In this way it is assured, 
that the microphone matching procedure is not influenced by the large differences in 
amplitude and/or phase which will occur when the hearing aid shell is touches. This may 
be extended such that the time pattern of the ratio between the two signals is determined 
for a given length of time. By doing this it becomes possible to determine the occurrence 

15 of repeated touching of the hearing aid. This could be used for communication of user 
input to the hearing aid. An example of user input could be program shifts or control of 
the volume. 

In a ftuther embodhnent of the invention the sign of the difference between the energies 
20 or the size of the ratio is calculated, whereby it is possible to determine whether the 
hearing aid casing is touched near the one or near the other microphone opening. This 
can be used to distinguish between at least two diJBFerent user inputs to the hearing aid. 

As seen in fig, 1, a measure for the energy content of the signal in the two microphone 
25 chamels is obtained by calculating the square of the signal value. Hereafter a mean value 
calculator is provided which will smooth the signal and dispense with very short term 
changes and ftuiher a down sampling of the microphone signals can be achieved, such 
that the power for the calculations is diminished. In the signal analyse block the 
difference or ratio between the energy of the microphone signals is determined, and the 
30 temporal changes in this value is analysed. 

At the casing a sound generating element can be arranged, which when touched provides 
a well defined sound impulse to the casing. This sound impulse may be detected through 
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the analyses of the signal from the microphones. Jn this way the user can interact with 
the listening device through the microphones of the device in a secure manner. The 
advantage here is that the listening device can be made without an elctro-mechanical 
button which is otherwise usual. The absence of the electro-mehanical button is 
5 advantageous as the electrical connection thereof to the signal processing device then 
becomes superfluous. 

The analyse block determines whether the signal from the microphone originates from 
touching the casing or from a soundsource in the environment. The input to the analyse 

10 block is an estimate of the power in each channel. On figure 2 the time related ratio 
between the two microphone channels is shown, whereby the vertical axis is the ratio: 
Chl/Ch2 and the horizontal axis is time. If the signal is a normal acoustic signal, then the 
ratio is constant over a short-term period, and this is shown as the horizontal line in the 
graph. If the environment is relatively quiet the noise from touching the microphone in 

15 chatmel 1 results in the ratio shown in fig. 2. The peak in fig. 2 originates from noise 
generated by touching of the casing material whereby a sudden change in the ratio 
between the energy contents in the two charmels will occur which is registered by the 
analyse block. If the rate of change is above a given threshold and at the same time the 
size of the value of Chl/Ch2 is above a given threshold, it is determined that the hearing 

20 aid casing is touched. 

If the enviromnent is not quiet the touching and possible closing or covering of the 
microphone channel results in an attenuation of the incoming signal. The ratio between 
the two channels in this case is as shown in fig. 3. This is usefiil in the event, where the 
25 user is to commvmicate with the hearing aid in an environment with very loud sound 
pressure. Here the microphones may be saturated and any additional sound, such as 
might be generated by touching the shell cannot be detected whereas fiie sudden absence 
of sound in one channel is easily detected as a sudden change of the value Chl/Ch2 and 
can be acted upon. 

30 

The analyse block can then extend this functionality to both microphones, so that the 
system reacts differently depending on whicli microphone the touching noise is centred. 



wo 2005/036924 



PCT/DK2004/000614 



6 

Another possibility is to measure the time between the touching of the inlets. The device 
could react differently if the inlets are touched more than ones in a specified time. This 
feature is showed in figure 4. By this possibility tiie user may be given the possibility to 
communicate with the hearing aid and have different actions like volimie up^ volume 
5 down or program changes effected. 



